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1  Abstract 


To  address  Air  Force  applications,  new  methods  are  developed  for  system  identifica¬ 
tion  (ID)  and  adaptive  control.  For  linear  systems,  ID  algorithms  are  developed  to  obtain 
consistent  parameter  estimates,  stable  models,  and  optimal  inputs.  Nonlinear  ID  methods 
are  developed  for  block-structured  models  with  measured-input  nonlinearities.  Subspace  ID 
methods  are  used  to  identify  linear  model  components,  while  optimization  methods  are  used 
to  construct  efficient  basis  functions.  Specialized  methods  are  developed  to  identify  nonlinear 
systems  with  output  nonlinearities,  limit  cycle  dynamics,  and  hysteresis.  Adaptive  stabiliza¬ 
tion  algorithms  are  developed  for  uncertain  linear  and  nonlinear  systems  under  full-state 
feedback,  as  well  as  linear  systems  with  unknown  but  bounded  relative  degree.  Extensions  to 
discrete-time  systems  are  addressed.  Adaptive  command-following  algorithms  are  developed 
for  spacecraft  and  demonstrated  on  an  experimental  testbed.  Adaptive  disturbance  rejection 
algorithms  are  developed  for  tonal  and  broadband  disturbances.  Nonlinear  control  algorithms 
are  developed  for  shape  change  actuation  for  spacecraft.  Semistability  theory  is  developed  to 
support  research  in  adaptive  control. 


2  Principal  Contributions  of  the  Project 

Applications  of  control-related  technology  range  from  “device”  scale  (for  example,  preci¬ 
sion  manufacturing  and  hard  drive  control)  to  “system”  scale  (for  example,  UAV  technology 
and  the  Airborne  Laser  program).  Control  technology  is  a  major  factor  in  the  success  of 
these  applications. 

This  project  addressed  a  broad  range  of  fundamental  issues  in  control-related  technology. 
Basic  research  results  were  obtained  in  the  areas  of  nonlinear  identification  and  adaptive 
control.  These  topics  focus  on  what  are,  in  our  view,  the  core  issues  in  system  technology, 
namely,  the  construction  of  models  based  on  empirical  data  for  use  in  controller  synthesis 
and  system  prediction,  as  well  as  the  development  of  control  algorithms  that  can  operate 
effectively  under  limited  modeling  information.  These  technologies  are  complementary  in 
the  sense  that  identification  is  used  to  provide  models  that  are  essential  for  control,  while 
adaptive  algorithms  are  forgiving  to  modeling  details  that  are  unknowable  in  advance  due  to 
changing  conditions. 

Our  research  in  this  program  focused  on  the  development  of  new  methods  that  have  broad 
application.  Rather  than  apply  known  methods,  our  experimental  work  has  motivated  and 
guided  the  development  of  new  techniques.  This  approach  has  been  the  underlying  principle 
behind  20  years  of  AFOSR-supported  research,  leading  to  more  than  150  journal  papers,  250 
conference  papers,  19  graduated  Ph.D.  students  in  12  years,  including  several  employed  by 
DOD  laboratories,  and  numerous  additional  contributions  relating  to  education,  service  to 
the  community,  and  widespread  interaction  with  industry  and  Government  personnel. 

For  this  final  report,  we  summarize  our  research  results,  which  encompass  a  diverse  col¬ 
lection  of  problems.  First  and  foremost,  our  main  thrusts  in  nonlinear  identification  and 
adaptive  control  include  new  techniques  for  nonlinear  identification  of  block-structured  mod¬ 
els  as  well  as  adaptive  tracking  and  disturbance  rejection.  These  results  are  directly  applicable 
to  problems  of  interest  to  DOD.  For  example,  we  have  developed  novel  techniques  for  non- 
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linear  system  identification  and  applied  them  to  space  weather  prediction.  We  have  also 
tested  these  identification  algorithms  on  fluid  flow  data.  In  adaptive  control,  we  extended 
prior  theory  on  harmonic  steady  state  adaptive  control,  providing  a  fully  model-free  approach 
that  has  direct  application  to  precision  optical  structures  under  development  at  AFRL/VS. 
Additional  contributions  include  a  definitive  experimental  demonstration  of  the  use  of  shape 
change  actuation  for  spacecraft  attitude  control.  This  idea  was  adopted  by  AFRL/VS  as  a 
topic  for  further  research  in  2003. 

As  already  noted,  our  program  incorporated  experimental  activities,  both  computational 
and  physical.  We  have  found  control  experiments  to  be  invaluable  for  testing  theoretical 
advances  by  assessing  their  performance  on  real  hardware.  Accordingly,  we  have  developed 
several  experimental  testbeds  at  the  University  of  Michigan.  Several  of  these  testbeds  were 
funded  under  the  DURIP  program.  We  have  used  these  testbeds  to  develop  new  ideas,  and 
we  have  made  excellent  use  of  them  in  our  research  program  [8, 18, 19, 23,39, 41] 

Additional  applications  include  flow  control,  although  such  experiments  are  not  available 
at  the  University  of  Michigan.  We  therefore  travelled  to  the  Air  Force  Academy,  where  we 
collected  data  using  the  AFOSR-supported  Cylinder  Wake  Benchmark  Experiment.  We  were 
the  first  outside  group  to  take  advantage  of  this  testbed. 

The  following  sections  summarize  the  principal  research  results  obtained  under  this 
project.  Details  are  given  in  our  referenced  papers,  which  are  available  from  standard  sources. 
The  reference  papers  contain  numerous  references  to  the  related  literature. 


3  Linear  System  Identification 


Some  of  the  techniques  needed  for  nonlinear  system  identification  are  extensions  of  linear 
system  identification  methods.  In  addition,  linear  system  identification  per  se  is  relevant  to 
precision  structures  applications  of  relevant  to  Air  Force  projects.  This  project  addressed 
several  aspects  of  linear  system  identification. 

In  [33]  we  developed  a  variation  of  least  squares  identification  to  guarantee  consistency 
of  parameter  estimates  in  the  presence  of  colored  process  noise.  In  [27]  we  applied  convex 
optimization  methods  to  enforce  model  stability  within  the  context  of  subspace  identification 
methods.  In  [21]  we  developed  an  optimal-input  identification  method  that  selects  inputs  to 
minimize  error  variance  as  predicted  over  a  finite  horizon.  Finally,  in  [17]  we  developed  an 
identification  method  that  removes  the  effect  of  spurious  low  frequency  modes  that  arise  in 
flexible  structure  identification. 


4  Nonlinear  System  Identification 

While  all  real  systems  are  nonlinear,  the  extent  to  which  nonlinearities  require  modeling 
is  application  dependent.  In  general,  the  presence  of  nonlinearities  can  render  linear  system 
identification  methods  ineffective.  Moreover,  poor  performance  of  linear  system  identifica¬ 
tion  methods  on  real  data  may  be  due  to  either  noise,  which  can  be  viewed  as  unmeasured 
inputs,  or  hidden  nonlinearities.  In  practice  it  may  be  difficult  to  determine  which  case  is 
operative  without  attempting  to  construct  a  model  of  the  unmeasured  noise  signal  or  the 
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hidden  nonlinearities. 

In  this  project  we  focused  on  block-structured  models  to  identify  nonlinear  subsystem 
components  as  separate  entities.  The  ability  to  visualize  these  components  is  useful  in  ap¬ 
plications.  The  most  basic  model  structures  are  the  Hammerstein,  Wiener,  and  nonlinear 
feedback  models  shown  in  Figure  1,  Figure  2,  and  Figure  3.  These  models  involve  the  inter¬ 
connection  of  a  single  linear  block  and  a  single  nonlinear  block. 


Figure  1:  Hammerstein  Model 


Figure  2:  Wiener  Model 


Figure  3;  Nonlinear  Feedback  Model 

In  [32]  we  developed  a  linear  spline  method  to  identify  Hammerstein  and  nonlinear  feed¬ 
back  models  with  single-input,  single-output  nonlinear  blocks.  Subsequently,  we  developed 
a  MIMO  extension  in  [22],  where  a  subspace  algorithm  is  used  along  with  a  basis  expansion 
for  the  nonlinear  maps.  The  function  expansion  is  linear  in  the  parameters,  which  allows  the 
nonlinear  system  identification  problem  to  be  recast  as  a  linear  system  identification  problem 
with  generalized  inputs.  The  multivariable  capability  of  subspace  algorithms  is  central  to 
this  approach  by  allowing  an  arbitrary  number  of  basis  functions. 

This  approach  requires  a  set  of  basis  functions  to  represent  the  nonlinear  mapping.  We 
therefore  developed  techniques  in  [31]  to  iteratively  refine  the  basis  function  representation  of 
nonlinear  mappings  that  are  functions  of  measured  inputs.  A  subspaoe  algorithm  is  used  to 
identify  the  linear  dynamics  for  a  chosen  set  of  basis  functions,  while  optimization  methods 
are  used  to  refine  the  set  of  basis  functions.  At  each  iteration,  a  singular  value  decomposition 
of  the  input  matrix  is  used  to  identify  the  dominant  nonlinearities.  The  overall  approach  can 
be  used  with  arbitrary  basis  functions  such  as  polynomials,  splines,  sigmoids,  or  Gaussian 
radial  basis.  Furthermore,  the  inputs  to  the  nonlinear  mapping  can  consist  of  exogenous 
system  inputs  as  well  as  outputs  that  are  fed  back  to  the  nonlinear  mapping. 


3 


To  illustrate  this  procedure,  consider  the  nonlinear  discrete-time  system 

yk  =  Cxk  +  G{uk),  (4.2) 

where  Xk  €  R",  uk  e  R"*,  yk  €  R^,  ^  S  R"’'",  C  €  RP""",  F:  R™  x  RP  ^  R”,  and 
G:  ”>  E^.  The  functions  F  and  G  can  be  written  in  terms  of  their  scalar- valued 

components  as 

■  Fi{u,y)  '  Gi{u) 

F{u,y)=  :  ,  G(«)=  :  ,  (4.3) 

Fn{u,y)  J  [  Gp{u)  _ 


where,  for  alH  =  1, . . . ,  n,  Fi :  E”^  x 
defining 


and,  for  alH  =  1, . . .  ,p,  Gi : 


the  system  (4.1),  (4.2)  can  be  illustrated  as  in  Figure  4,  where  X:  E’^  x  ' 
represents  the  linear  system 

Xk+l  =  AXk  +  [  /n  0]zk, 

Vk  ~  Gxk  4"  [  0  Ip  ^  Zk) 

where  =  J^iuk^yk)  is  viewed  as  an  unmeasured,  exogenous  input  to  -C. 


and  L 


Figure  4:  Nonlinear  system  with  measured-input  nonlinearities. 


The  main  feature  of  the  model  (4.5),  (4.6)  is  the  fact  that  all  of  the  inputs  to  JsT  are 
measured.  Therefore,  the  model  (4.1),  (4.2)  includes  the  Hammerstein  and  nonlinear  feedback 
models  shown  in  Figure  1  and  Figure  3.  However,  (4.1),  (4.2)  does  not  encompass  the  Wiener 
model  shown  in  Figure  2. 

Next,  assume  that  the  components  Fi  and  Gi  can  be  expanded  in  terms  of  basis  functions 
fi(u,y),...,fq{u,y),  giiu),...,gr{u),  and  hi(u), . . .  ,hs{u)  as 

’  Ei=l^/li/i(^>J/) +  Ei=l^hli^i(«)  ' 

Fiu,  y)=  \  ,  (4.7) 

1  bfnifi{u,  y)  +  Xjt=l  ^h.nihi{u) 

1  dgii9t(u)  +  y3i=l  ^/ili^i(^) 

G(n)  =  :  .  (4.8) 

yz»=l  dgpigi{u)  +  dhpihiiu) 
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The  functions  hi  axe  the  basis  functions  that  are  common  to  both  F  and  G.  Defining  / ;  R*”  x 
RP  R™  ->  R*-  and  h:  R™  R®  by 

'  fiiu,y)  1  r  9i{u)  hi{u) 

f{u,y)=  ;  ,  9{u)=  :  ,  h{u)=  \  ,  (4.9) 

.  /9(w,y)  J  L  9t{u)  J  [  hs{u)  _ 

it  follows  from  (4.8)  that 

F{u,y)  =  Bffiu,y)  +  Bhh{u),  G{u)  =  Dgg{u)  +  Dhh{u),  (4.10) 

where  Bf  =  [bfij]  €  Bh  =  [bhij]  €  R”^*,  Dg  =  [d^y]  €  and  Dh  =  [4y]  € 

Thus  (4.1),  (4.2)  can  be  written  as 

Xk+i  =  Axk  +  Bff{uk,yk)  +  BhHuk),  (4.11) 

yk  =  Cxk  +  Dgg{uk)  +  Dhh{uk),  (4.12) 

or  more  compactly  as 

’  f{uk,yk)  1 

Xk+\  =  Axk  +  B  g{uk)  ,  (4.13) 

h{uk) 

'  f{uk,yk)  1 

yk  =  Gxk  +  D  9{uk)  ,  (4.14) 

h{uk) 

where 

B=[Bf  0  Bh],  D=[0  Dg  Dh].  (4.15) 


The  nonlinear  system  identification  problem  is  to  construct  models  of  both  L  and  X  given 
measurements  of  (uk^yk)  over  the  interval  0  <  k  <  £.  The  signal  z  is  assumed  to  be  unavail¬ 
able. 
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The  next  step  is  to  refine  the  representation  of  the  nonlinear  subsystem  blocks.  We 
illustrate  the  procedure  for  the  Hammerstein  case  (4.20),  (4.21).  To  begin,  consider  an  initial 


set  of  basis  functions  hi^..,hs  with  hi  •••  h§  and  let  (A^B.C^D)  denote  an 


estimate  of  {A^B.C^D 
value  decomposition  of 


provided  by  the  subspace  algorithm. 
4l  written  in  standard  notation  as 


Next,  consider  the  singular 


B 

D 


=  UEV. 


(4.22) 


Then,  we  retain  the  largest  u  singular  values  in  B  to  obtain  the  approximation  E  ^  Eq  = 
LoRo,  where  rank^o  ===  ^  and  the  matrices  Lq  G  and  Rq  G  have  full  col¬ 

umn  rank  and  full  row  rank,  respectively.  The  retained  u  largest  singular  values  can  be 
incorporated  into  either  Lq  or  This  yields  the  approximation 


h{u)  =  UEVh{u)  «  UEoVh{u)  =  ULoRoVh{u)  = 


Bo 

Do 


ho{u), 


(4.23) 


where  the  matrix  j  ^  ULo  €  and  ho{u)  =  RoVh{u)  satisfying  ho: 

is  a  column  vector  consisting  of  u  scalar- valued  nonlinear  functions.  The  motivation  for 
this  procedure  is  to  retain  only  u  scalar- valued  nonlinear  functions  each  of  which  is  a  linear 
combination  of  s  basis  functions.  Since  u  «  s,  the  i/  scalar- valued  components  of  ho  can 
be  viewed  as  dominant  nonlinearities,  while  the  choice  of  u  reflects  the  rank  of  the  nonlinear 
mapping  [g]  . 

With  the  basis  functions  fi{u,  y),gi{u),  hi{u)  specified,  subspace  algorithms  can  be  applied 
to  the  system  (4.5),  (4.6)  with  the  signal  z  playing  the  role  of  the  exogenous  input.  This  is 
the  approach  developed  in  [22].  The  type  of  basis  functions  chosen  (for  example,  polynomial, 
spline,  or  radial  basis  functions)  will,  in  general,  affect  the  number  of  basis  functions  needed 
to  achieve  a  satisfactory  approximation  of  the  nonlinear  mappings  in  a  particular  applica¬ 
tion.  While  subspace  identification  yields  the  coefficient  matrices  (^4,  B,(7,  Z)),  it  does  not 
determine  the  basis  functions.  Consequently,  in  [31]  we  extended  this  nonlinear  identification 
approach  to  include  the  ability  to  optimize  over  a  class  of  basis  functions.  For  example,  if 
Gaussian  radial  basis  functions  are  used,  then  these  functions  can  be  optimized  with  respect 
to  the  center  location  and  half-width. 

We  address  this  problem  in  [31]  by  optimizing  the  fit  error  with  respect  to  the  parameters 
that  characterize  the  basis  functions.  For  example,  for  the  case  of  Gaussian  radial  basis  func¬ 
tions,  gradient  expressions  with  respect  to  the  center  locations  and  half- widths  are  derived, 
and  numerical  optimization  alternately  with  subspace  identification  to  determine  both  the 
linear  model  and  basis  functions  to  minimize  the  fit  error.  A  less  computationally  intensive 
procedure  is  to  choose  random  basis  functions,  which  are  retained  or  discarded  based  on  their 
effectiveness  in  reducing  the  fit  error. 

To  illustrate  the  nonlinear  identification  algorithm  for  nonlinear  system  identification,  we 
consider  a  data  set  used  for  space  weather  prediction.  The  input  data  set  was  measured  by  the 
NASA  Advanced  Composition  Explorer  (ACE)  spacecraft  and  includes  the  three  components 
of  the  magnetic  field  vector  as  well  as  the  solar  wind  speed,  solar  wind  proton  density,  and 
temperature.  The  system  output  is  the  cross  polar  cap  potential,  which  is  derived  from  85 
magnetometers  located  in  Greenland,  Canada,  Scandinavia,  Alaska,  and  Russia. 


6 


For  the  data  fit  shown  in  Figure  5,  3  of  the  7  inputs  (the  solar  wind  speed  and  two 
components  of  the  magnetic  field)  are  used  to  construct  a  rank  2  input  nonlinearity,  that  is, 
a  Hammerstein  system  with  two  dominant  nonlinearities.  The  final  rank  2  input  nonlinearity 
is  a  combination  of  135  radial  basis  functions.  The  linear  dynamics  identified  by  the  subspace 
algorithm  are  second  order. 


Figure  5:  Data  fit  for  space  weather  system  with  three  inputs  and  one  dominant  nonlinearity 
represented  by  135  radial  basis  functions. 


As  a  second  example,  we  consider  experimental  data  obtained  for  the  NASA  Dryden 
Aerostructures  Test  Wing  (ATW),  mounted  on  an  F-15  to  provide  a  flying  wind  tunnel.  The 
data  used  for  identification  are  obtained  from  a  test  performed  at  Mach  number  0.80  and 
altitude  20,000  ft. 

The  identification  input  is  a  5  to  35  Hz  sine  sweep  applied  to  piezoelectric  patches  on  the 
ATW.  The  output  is  the  acceleration  of  the  ATW  boom  at  mid-length.  A  total  of  60  sec  of 
recorded  data  is  available,  of  which  2  sec  of  data  are  used  for  nonlinear  system  identification.' 
The  identified  model  is  5th-order  with  a  rank  1  input  nonlinearity.  For  initialization,  15  evenly 
spaced  radial  basis  functions  are  used  for  the  first  iteration.  For  visualization  purposes.  Figure 
6  shows  1  sec  of  data  fit,  and  the  identified  dominant  nonlinearity  is  shown  in  Figure  7.  These 
methods  were  also  applied  to  laboratory  data  obtained  from  testing  linear  motors  in  [24]. 

As  an  additional  application  of  this  nonlinear  identification  method,  we  participated  in 
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Figure  6:  Data  fit  for  test  wing  with  piezo  sine  sweep  forcing  under  constant  aerodynamic 
conditions. 


the  AFOSR-supported  Cylinder  Wake  Benchmark  Experiment  developed  at  the  Air  Force 
Academy.  This  flow  control  experiment  is  set  in  a  water  tunnel  with  PIV  flow  sensing. 
Nominal  operation  is  at  a  Reynolds  number  of  120  and  a  natural  vortex  shedding  frequency 
of  1.2  Hz.  The  controller  sampling  rate  is  30  Hz  with  70  ms  time  delay  due  to  PIV  processing 
and  data  transfer,  which  corresponds  to  10%  of  the  natural  vortex  shedding  frequency.  The 
objective  of  the  testbed  is  to  use  feedback  control  to  reduce  drag  on  a  cylinder  that  can  be 
moved  in  a  vertical  plane.  The  experiment  has  been  designed  to  allow  outside  researchers  to 
test  control  methods.  Control  software  is  implemented  on  a  dSPACE  system  that  is  identical 
to  systems  at  the  University  of  Michigan. 

For  the  Cylinder  Wake  Benchmark  Experiment,  Dr.  Stefan  Siegel  has  made  available  2D 
CFD  simulation  data  for  the  velocity  field  downstream  from  the  cylinder  for  both  harmonic 
and  chirp  cylinder  motion.  CFD  simulation  is  performed  using  the  Cobalt,  Inc.,  Navier-Stokes 
flow  solver  with  an  interface  to  Mat  lab  for  sensing,  actuation,  and  controller  implementation. 
Numerical  results  obtained  under  harmonic  cylinder  motion  at  the  natural  vortex  shedding 
frequency  show  sinusoidal  velocity  response.  For  chirp  cylinder  motion,  the  velocity  response 
is  more  complex. 

For  the  chirp  cylinder  data,  we  applied  the  selective  refinement  nonlinear  system  identifi- 
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Figure  7:  Dominant  identified  input  nonlinearity  for  the  Dryden  test  wing  with  piezo  forcing 
using  a  5th-order  Hammerstein  model  and  a  rank  1  nonlinearity. 


cation  algorithm  to  obtain  a  model  that  fits  both  components  of  the  velocity.  A  total  of  400 
time  steps  of  CFD  data  were  provided  for  the  case  of  chirp  signal  cylinder  displacement.  The 
data  fit  for  the  x  velocity  component  at  a  point  downstream  is  shown  in  Figure  8,  while  the 
identified  nonlinearity  is  shown  in  Figure  9.  The  identification  data  fit  was  found  by  choos¬ 
ing  an  initialization  of  11  radial  basis  functions,  and  the  subspace  identification  algorithm 
identified  a  9th-order  linear  system.  Although  spanwise  modes  are  assumed  to  be  excited  by 
this  motion,  3D  CFD  data  are  not  available. 

The  block-structured  nonlinear  models  identified  by  the  methods  described  above  can  be 
used  in  nonlinear  control  design.  We  considered  nonlinear  control  of  Hammerstein  systems 
for  applications  involving  electromagnetic  actuation  in  [36]. 

The  methods  discussed  above  are  limited  to  nonlinear  systems  whose  nonlinear  maps 
have  measured  inputs.  Models  of  interest  that  do  not  satisfy  this  assumption  include  Wiener 
systems  whose  output  map  may  not  be  one-to-one.  Partial  results  on  this  problem  include 
the  case  of  a  known,  non-invertible  (that  is,  not  one-to-one)  output  mapping  [28]  as  well  as 
the  case  of  an  unknown,  non-invertible  output  mapping  with  the  linear  dynamical  system 
assumed  to  be  finite  impulse  response  [25].  The  interesting  feature  of  these  systems  is  the 
fact  that  they  appear  to  be  identifiable  despite  the  ambiguity  in  their  output  maps. 
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Figure  8:  ^-direction  data  fit  for  Cylinder  Wake  Benchmark  Experiment  using  a  9th-order 
model  and  a  rank  1  input  nonlinearity. 


As  a  special  class  of  nonlinear  system  identification  problems,  we  also  considered  the  iden¬ 
tification  of  systems  with  limit  cycles.  Systems  with  limit  cycles  are  self  oscillating,  that  is, 
they  have  the  property  that  constant  inputs  produce  periodic  outputs.  Applications  include 
aerodynamic  instabilities  (surge  and  stall),  aeroeiastic  instabilities  (flutter),  thermoacoustic 
instabilities  (combustion),  contact  instabilities  (chatter,  squeal),  rotating  instabilities  (unbal¬ 
anced  rotors  and  linkages),  and  hysteresis  (relays,  backlash).  The  results  given  in  [26]  are 
based  on  techniques  that  are  closely  related  to  the  reconstruction  and  restoration  methods 
developed  in  the  dynamical  systems  literature. 

Finally,  we  developed  nonlinear  identification  methods  for  a  class  of  systems  that  model 
hysteresis.  The  semilinear  Duhem  model  provides  a  finite-dimensional  model  that  can  capture 
both  rate-independent  and  rate-dependent  hysteresis  effects.  The  semilinear  Duhem  model 
was  analyzed  in  [29],  and  nonlinear  identification  methods  were  demonstrated  in  [29,30]. 
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Figure  9:  Dominant  identified  nonlinearity  for  Cylinder  Wake  Benchmark  Experiment. 

5  Adaptive  Control 


Our  research  in  adaptive  control  encompasses  adaptive  stabilization,  adaptive  command 
following,  and  adaptive  disturbance  rejection.  In  adaptive  stabilization  and  command  fol¬ 
lowing,  noise  and  disturbance  signals  are  usually  not  considered.  In  adaptive  disturbance 
rejection,  the  plant  is  usually  assumed  to  be  open-loop  stable,  and  the  key  objective  is  to 
reduce  the  effect  of  disturbances. 

The  goal  of  adaptive  stabilization  is  to  devise  a  controller  that  can  stabilize  the  plant 
under  limited  modeling  information  and  through  continual  gain  adjustment.  Our  earliest 
work  on  this  topic  was  [20],  which  provided  aii  accessible  introduction  to  the  basic  ideas.  We 
subsequently  showed  that  this  controller  is  effective  for  certain  classes  of  nonlinear  and  time- 
varying  systems  [34,35].  Additional  results  include  adaptive  stabilization  of  linear  systems 
with  unknown  but  bounded  relative  degree  as  considered  in  [16]. 

For  spacecraft  applications  we  developed  an  adaptive  command-following  controller  in  [2] 
for  spacecraft  with  unknown  mass  distribution  (including  unknown  moments  of  inertia  and 
center  of  mass),  and  we  developed  similar  controllers  for  a  dual-gimbal  control-moment  gyro 
and  a  rigid  rotor,  which  was  implemented  on  an  experimental  testbed  [1].  More  recently  [38], 
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Figure  10:  TViaxial  testbed.  This  3D  attitude  control  testbed  uses  a  low-friction  triaxial 
air  bearing  to  emulate  three-dimensional  rotational  dynamics.  Reaction  wheels  and  fan 
thrusters  are  used  for  actuation.  Inertial  sensors  and  magnetometers  are  used  for  attitude 
estimation. 


we  applied  a  related  approach  to  an  experimental  testbed  that  simulates  spacecraft  motion  in 
up  to  3  degrees  of  freedom  (see  Figure  10).  For  this  testbed,  torque  inputs  are  realized  by  fans, 
which  possess  nonlinearity  that  degrades  the  tracking  performance  and  inertia  estimates.  For 
this  system,  which  is  a  Hammerstein  system  with  unknown  input  nonlinearity,  the  adaptive 
control  law  lacks  robustness  to  harmonic  commands.  Therefore,  we  implemented  adaptive 
feedback  linearization  in  [37]  to  adaptively  invert  the  input  nonlinearity  in  conjunction  with 
inertia  identification. 

For  digital  implementation,  we  explored  these  problems  in  a  discrete-time  setting.  First, 
we  considered  adaptive  stabilization  with  both  quadratic  and  logarithmic  Lyapunov  functions 
[4,44].  We  showed  in  [5]  that  discrete-time  adaptive  control  laws  require  normalized  gain 
updates,  which  can  be  shown  to  be  Lyapunov  stable  using  logarithmic  Lyapunov  functions. 
Logarithmic  Lyapunov  functions  were  also  applied  to  the  problem  of  discrete-time  model 
reference  adaptive  control  in  [3],  where  Lyapunov  stability  was  shown. 

The  problem  of  adaptive  disturbance  rejection  generally  assumes  that  the  plant  is  open- 
loop  stable,  and  seeks  to  suppress  disturbances  under  minimal  plant  and  disturbance  model¬ 
ing.  For  this  problem  it  is  important  to  make  a  distinction  between  tonal  (sum  of  sinusoids) 
and  broadband  disturbances.  For  tonal  disturbances  that  are  not  measured,  the  classical  ap¬ 
proach  to  disturbance  rejection  is  to  use  a  controller  that  includes  a  model  of  the  exogenous 
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Figure  11:  Experimental  application  of  harmonic  steady  state  adaptive  control.  This  algo¬ 
rithm  uses  a  recursive  least  squares  estimator  to  obtain  a  completely  model-free  disturbance 
rejection  algorithm  for  tonal  disturbances. 


disturbance  in  accordance  with  the  internal  model  principle.  Internal-model-based  control 
has  the  useful  property  that  neither  the  amplitude  nor  the  phase  of  the  disturbance  need 
be  known  for  asymptotic  disturbance  rejection.  However,  in  order  to  implement  an  internal 
model  controller,  some  plant  modeling  information  is  needed  to  ensure  stability.  In  fact,  it 
can  be  shown  that,  with  sufficiently  small  feedback  gains,  closed- loop  stabilization  requires 
knowledge  of  the  sign  of  the  imaginary  part  of  the  plant  frequency  response  at  the  distur¬ 
bance  frequency.  An  additional  difficulty  arises  when  the  frequency  of  the  disturbance  is  not 
known.  In  this  case,  an  adaptive  controller  is  needed,  and  a  globally  convergent  algorithm 
for  this  problem  (even  in  the  presence  of  a  fully  modeled  plant)  remains  open. 

To  address  this  problem,  we  considered  the  approach  of  harmonic  steady  state  control, 
which  is  closely  related  to  higher  harmonic  control  applied  to  rotorcraft  vibrations.  In  this 
approach,  the  disturbance  is  assumed  to  be  tonal,  and  the  system  is  allowed  to  reach  harmonic 
steady  state.  In  [14]  we  extended  existing  methods  to  include  a  concurrent  identification 
algorithm.  The  resulting  algorithm  is  fully  adaptive  and  model  free.  Experimental  results 
obtained  for  an  acoustic  testbed  are  shown  in  Figure  11. 

In  prior  research,  we  developed  the  ARMarkov  adaptive  cancellation  algorithm  [42, 43].  In 
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this  approach,  controller  synthesis  is  based  on  ARMarkov  models  and  thus  Markov  parame¬ 
ters.  The  ARMarkov  adaptive  disturbance  rejection  algorithm  requires  no  prior  knowledge  of 
the  disturbance  spectrum  and  minimal  modeling  of  the  plant  dynamics.  Specifically,  a  model 
of  the  transfer  function  Gzu  from  control  to  performance  is  required,  while  no  knowledge  of 
the  remaining  transfer  functions  Gzw,Gyw,Gyu  (from  control  to  measurement,  disturbance 
to  performance,  and  disturbance  to  measurement)  is  needed.  None  of  these  transfer  functions 
is  assumed  to  be  positive  real,  and  the  algorithm  does  not  require  accessibility  of  either  the 
disturbance  signal  or  the  full  state. 

In  laboratory  experiments,  we  have  applied  the  ARMarkov  adaptive  control  algorithm  to 
noise  and  vibration  control  testbeds  with  both  stationary  and  nonstationary  disturbances, 
including  single  tones,  multiple  tones,  white  noise,  and  sine  sweeps.  In  these  experiments  the 
controller  has  no  prior  knowledge  of  the  nature  of  the  disturbance,  and  only  the  (MIMO) 
transfer  function  Gzu  control  inputs  to  performance  variables  is  identified  in  advance. 
Figures  12  and  13  show  experimental  results  for  dual-tone  and  white  noise  disturbances 
after  controller  convergence.  The  algorithm  has  also  been  applied  to  a  structural  vibration 
experiment  shown  in  Figure  14  involving  membrane  dynamics  [18]. 


Figure  12:  This  frequency  response  plot  compares  the  open-  and  closed-loop  performance 
of  the  ARMarkov  adaptive  control  algorithm  with  dual-tone  disturbance.  The  adaptive 
control  algorithm  has  knowledge  of  only  the  zeros  of  the  transfer  function  Gzu  and  has  no 
knowledge  of  the  disturbance  spectrum. 
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Figure  13:  This  frequency  response  plot  compares  the  open-  and  closed- loop  performance 
of  the  ARMarkov  adaptive  control  algorithm  with  broadband  disturbance. 


6  Linear  Systems  and  Control 

A  comprehensive  study  of  guaranteed  cost  bounds  for  robust  stability  and  performance 
analysis  is  given  in  [10].  Robust  fixed-structure  controllers  formulated  in  the  delta  domain 
are  considered  in  [15]. 

Vibration  analysis  of  coupled  oscillators  is  treated  in  [6],  while  reversible  linear  systems 
are  characterized  in  [7].  These  results  contribute  a  systems  theory  foundation  for  thermody¬ 
namics,  with  application  to  active  vibration  control. 


7  Nonlinear  Control 

Nonlinear  control  methods  were  developed  for  spacecraft  control  with  shape  change  actu¬ 
ation.  These  methods  use  changes  to  the  spacecraft  configuration  to  enable  attitude  control. 
Controllers  were  implemented  on  a  laboratory  testbed  involving  single-degree-of-freedom  mo¬ 
tion  and  moving-mass  actuation  [9].  The  laboratory  testbed  is  shown  in  Figure  15.  Extensions 
to  3-dimensional  attitude  control  are  studied  in  [40] . 
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Figure  14:  Membrane  control  experiment.  A  commercial  bass  drum  provides  a  flexible 
membrane  for  adaptive  disturbance  rejection  experiments.  An  array  of  seven  audio  speakers 
is  mounted  beneath  the  membrane  for  excitation,  while  a  laser  and  optical  sensor  are  used 
to  measure  surface  slope  deflection. 
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Figure  15:  Shape  change  actuation  experiment.  An  air  bearing  allows  frictionless  motion 
about  a  single  axis  for  attitude  control  experiments.  A  pair  of  moving-mass  actuators  is 
used  for  shape  change  actuation.  Several  nonlinear  control  algorithms  were  implemented 
on  the  tested. 


To  support  research  in  adaptive  control,  we  developed  the  theory  of  semistability,  which 
applies  to  systems  with  a  continuum  of  equilibrium.  This  property  is  relevant  to  adaptive 
control  systems,  where  parameter  estimates  need  not  converge  to  the  true  parameter  values. 
Arc  length  tests  for  convergence  were  developed  in  [12],  while  nontangency  tests  are  developed 
in  [13]. 

Nonlinear  controllers  for  finite-time  stability  were  developed  in  [11]. 
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